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(57) Abstract: There is disclosed 
an apparatus for inserting new data 
packets into an incoming digital 
video transport stream containing a 
plurality of original data packets. 
The apparatus comprises: 1) an input 
buffer for storing the original data 
packets of the incoming digital video 
stream; and 2) a video j^rocessor 
that retrieves the stored original data 
packets from the input bufifer and 
determines from the original data 
packets N data frequencies associated 
with N most recently received ones of 
the plurality of original data packets. 
The video processor estimates from 
the N data frequencies an estimated 
data frequency of a plurality of next 
incoming original data packets and 
uses the estimated data frequency to 
determine an insertion rate at which 
the new data packets may be inserted 
into the plurality of next incoming 
original data packets. 
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System and method for inserting video and audio packets into a video transport stream 



The present invention is directed, in general, to video broadcasting systems 
and, more specifically, to a system and method for inserting data packets into available 
spaces in a video transport stream. 

Conventional television broadcast systems, including both wireless and cable 
5 systems, increasingly are being used to transmit data streams other than the basic television 
programs carried by the broadcast systems. For example, cable television systems now 
provide Internet access services to cable subscribers. The Intemet data is carried in dedicated 
channels that are set aside for bidirectional Intemet protocol (IP) traffic. Broadcast systems 
also transmit electronic program guide (EPG) data streams that contain information related to 
10 program titles, broadcast times, channel assignment, content summary, and the like. The 
television set or a set-top box (STB) allows a television viewer to review the EPG data on a 
selected charmel by selecting a MENU or PROGRAM option on the remote control. 

A digital broadcast transport stream contains video, audio, and data packets. 
Normally, there are spaces or null packets in the transport stream where additional data 
15 packets may be inserted. These additional data packets may include video clips, audio tracks, 
application programs, text files, and the like. It also is possible to insert additional data by 
replacing some of the data packets akeady in the transport stream. For example, a cable 
company may receive fi-om a network video source a transport stream containing data 
packets Jfor commercials, text, and EPG information. The cable system may xeplace liie 
20 existing commercials and EPG data with replacement commercials and a new EPG for the 
local area. The gaps in the transport stream and the replaceable data packets in a transport 
stream constitute the available data bandwidth for insertion of new data packets. 

The insertion can be done at various points of tibe delivery chain, for example, 
at local affiliates of a network. The inserted data packets can include local advertisements, 
25 web pages (perhaps tied to the original vid^o stream), local weather reports, and the like. The 
inserted data formats include IP packets, MPEG packets. This capability of mserting data into 
a broadcast stream provides opportunities for service providers to provide new services to 
consumers. 
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The available data bandwidth for data insertion in the broadcast stream varies 
with time. A mechanism is needed to predict the available data bandwidth in the near future 
(e.g., next several seconds to half an hour) to use the available bandwidth efficiently. For 
example, suppose the data is streamed from a stock ticker web site at a configurable rate. If 
5 the streaming processor at the web site sends data at a rate higher than the available data 
bandwidth can accommodate, then some data from the stock ticker web site will be dropped. 
By estimating the available data bandwidth in a broadcast transport stream, the data insertion 
device can notify the streamer of the desired streaming data rate. 

There is therefore a need in the art for improved broadcast systems disposed in 

10 downstream location capable of inserting new data packets into a digital transport stream. In 
particular, there is a need for video processing systems capable of more accurately estimating 
the available bandwidth for inserting new data packets in the next N seconds of a digital 
video transport stream. 

To address the above-discussed deficiencies of the prior art, it is a primary 

1 5 object of the present invention to provide,e.g. foruse in a broeidcast facility, an apparatus for 
inserting new data packets into an incoming digital video transport stream containing a 
pluraUty of original data packets. According to an advantageous embodiment of the present 
invention, the apparatus comprises: 1) an input buffer capable of storing the original data 
packets of the incoming digital video stream; and 2) a video processor capable of retrieving 

20 the stored original data packets from the input buffer and determining from the original data 
packets N data frequencies associated with N most recently received ones of the plurality of 
original data packets, wherein the video processor estimates from the N data frequencies an 
estimated data frequency of a plurality of next incoming original data packets and uses the 
estimated data frequency to determine an iosertion rate at which the new data packets may be 

25 inserted into the plurality of next incoming original data packets. 

According to one embodiment of the present invention, the video processor is 
further capable of identifying in the stored original data packets replaceable data packets not 
associated with at least one elementary data stream comprising a program carried in the 
incoming digital video transport stream. 

30 According to another embodiment of the present invention, the video 

processor inserts the new data packets into the plurality of next incoming original data 
packets by replacing at least one replaceable data packet in the plurality of next incoming 
original data packets. 
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According to still another embodiment of the present invention, the video 
processor is further enable of identifying in the original data packets null data packets. 

According to yet another embodiment of the present invention, the video 
processor inserts the new data packets into the plurality of next incoming original data 
5 packets by replacing at least one nuU data packet in the plurality of next incoming original 
data packets. 

According to a further embodiment of the present invention, the video 
processor estimates the insertion rate as a function of a summation of the M most recently 
received original data packets. 
1® According to a still further embodiment of the present invention, each of the 

M most recently received original data packets in the simamation is scaled by a weighting 
factor, a(k). 

The foregoing has outlined rather broadly the features and technical 
advantages of the present invention so that those skilled m the art may better understand the 
15 detailed description of the invention that follows. Additional features and advantages of the 
invention will be described hereinafter lhat form the subject of the claims of the invention. 
Those skilled in the art should appreciate tiiat they may readily use the conception and the 
specific embodiment disclosed as a basis for modifying or designing other structures for 
carrying out the same purposes of the present mvention. Those skilled m the art should also 
20 realize that such equivalent constructions do not depart firom the spirit and scope of the 
invention in its broadest form. 

Before imdertaking the detailed description, it may be advantageous to set 
forth definitions of certain words and phrases used throughout this patent document: the 
terms "include" and "comprise," as well as derivatives thereof, mean inclusion without 
25 limitation; the term "or," is inclusive, meaning and/or; the phrases "associated with" and 
"associated therewith," as well as derivatives thereof, may mean to include, be included 
within, mterconoaect with, contain, be contained within, connect to or with, couple to or with, 
be communicable with, cooperate with, interleave, juxtapose, be proximate to, be bound to or 
with, have, have a property of, or the like; and the tsrm "controller" means any device, 
30 system or part thereof that controls at least one operation, such a device may be implemented 
in hardware, firmware or software, or some combination of at least two of the same. It should 
be noted that the functionality associated with any particular controller may be centralized or 
distributed, whether locally or remotely. In particular, a controller may comprise one or more 
data processors, and associated input/ou^ut devices and memory, that execute one or more 
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application programs and/or an operating systena program. Definitions for certain words and 
phrases are provided throughout this patent document, those of ordinary skill in the art should 
understand that in many, if not most instances, such definitions apply to prior, as well as 
future uses of such defined words and phrases. 



For a more complete understanding of the present invention, and the 
advantages thereof, reference is now made to the following descriptions taken in conjunction 
with the accompanjdng drawings, wherein like numbers designate like objects, and in which: 
1 0 Fig. 1 illustrates an exemplary television broadcast system according to one 

embodiment of the present invention; 

Fig. 2A illustrates an exemplary incoming digital data transport stream 
received at the local broadcast facility in Fig. 1 according to one embodiment of the present 
invention; 

15 Fig. 2B illustrates an exemplary outgoing digital data transport stream 

transmitted firom the local broadcast facility in Fig. 1 according to one embodiment of the 
present invention; 

Fig. 3 illustrates in greater detail selected portions of the local broadcast 
facility according to one embodiment of the present invention; and 
20 Fig. 4 is a flow diagram illustrating the data firequency estimation algorithm 

performed by the video processor in tiie local broadcast facility according to one embodiment 
of the present invention. 



25 Figs. 1 through 4, discussed below, and the various embodiments used to 

describe the principles of the present invention in this patent document are by way of 
illustration only and should not be construed in any way to limit the scope of the invention. 
Those skilled in the art will understand that the principles of the present mvention may be 
implemented in any suitably arranged digital broadcast system. 

30 Fig. 1 illustrates exemplary television broadcast systerii 100 according to one 

embodiment of the present invention. Television broadcast system 100 comprises local 
broadcast facility 110, which receives one or more digital video transport streams fix)m each 
of network video sources 121-123. Local broadcast facility 1 10 may receive these digital 
video transport streanas firom wireline communication links or from wireless communication 
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links. For example, local broadcast facility 110 receives one or more digital video transport 
streams from network video source 121 via wireline communication link 131 and receives 
one or more digital video transport streams from network video source 122 via wireline 
commimication link 132. 
5 Local broadcast facility 110 also comprises base transceiver stations 134 and 

135, vAAch wirelessly transmit one or more digital video transport streams from network 
video source 123 to local broadcast &cility 1 10. In an exemplary embodiment, network video 
source 123 may transmit the digital video transport streams via communication line 133 to 
base transceiver station 134, whidi is part of a local multipoint distribution system (LMDS) 

10 network. In an LMDS network, a microwave link is used to transmit the digital video 
transport stream from base transceiver station 134 to base transceiver station 135. 

Local broadcast facility 110 transmits the digital video transport streams to 
subscriber locations 141-143, which may include both private residences and business 
locations. If local broadcast facility 1 10 is part of a cable television system, local broadcast 

1 5 facility 1 1 0 may transmit one or more outboxmd digital video transport streams to subscriber 
locations 141 and 142 via communication wireline 151. Communication wireline 152 carries 
one or more outbound digital video transport streams from local broadcast fecility 1 1 0 to 
transmitter 143, which wirelessly transmits the outbound digital video transport streams to 
subsmber location 143. 

20 Each of the digital video transport streams received by and transmitted by 

local broadcast facility are carried in a 6 MHz broadcast channel. A transport stream usually 
contains several virtual channels, with each virtual channel containing a program. The 
program carried in a virtual channel is what a viewer sees on a signal television chaimel, such 
as a movie, a newscast, and a weather channel. Normally, each virtual channel is edlocated a 

25 fixed bandwidth, such as 3 Megabits per second (Mbps). 

The program in a virtual channel may contain several elementary streams, 
including a video stream, an audio stream, and a data stream. These elementary streams are 
digitally compressed. When the digitally compressed elementary streams carried in the 
virtual chaimel do not use iq? all of the allocated bandwidtiii, the remaining bandwidth may be 

30 filled with null packets in ordsc to maintain a steady overall data throughput. However, at 
some points along the delivery chain, such as at local broadcast &cility 110, useful data can 
be inserted into a virtual channel by replacing these null packets. Additionally, new data 
packets may be inserted by replaciag existing data packets that belong to a replaceable 
elementary stream already in a virtual channel. 
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Fig. 2A illustrates exemplary incomiag digital data transport stream 200 
received at local broadcast facility 110 according to one embodiment of the present 
invention. Incoming digital data transport stream 200 comprises a plurality of non- 
replaceable packets, replaceable packets, null packets. By way of example, anon-replaceable 
5 packet (NRP) may be a data packet that is part of the elementary stream (e.g., audio or video) 
of the television program being viewed by a cable subscriber. Some of the non-replaceable 
(NRP) packets may include electronic program guide (EPG) data packets. A replaceable 
packet (RP) mscy be an additional audio, video, or text data packet that is not part of the 
television program being viewed by the cable subscriber and that had previously been 

10 inserted into the digital video transport stream at another network facility further upstream. 

In the exemplary embodunent, an elementary time jBrame T of incoming digital 
data transport stream 200 having a duration of, for example, 100 milliseconds is shown. The 
time frame T of incoming digital data transport stream 200 comprises non-replaceable 
packets 201-203 and 207-209, replaceable packets 204-206, and null packets 210-211. It is 

15 assumed that the packets are moving in the broadcast chain at a constant speed. As is 

illustrated in Fig. 2A, the null packet clxisters have a frequency of approximately 9% (2 out of 
1 1 packets) and size of two packets, the replaceable packet clusters have a frequency of 27% 
(3 out of 1 1 packets) and size of 3 packets, and the non-replaceable packet clusters have a 
frequency of 27% (3 out of 1 1 packets) and size of 3 packets. 

20 Fig. 2B illustrates exemplary outgoing digital data transport stream 250 

transmitted from local broadcast facility 110 according to one embodiment of the present 
invention. Outgoing digital data transport stream 200 results from the replacement of some of 
the data packets in incoming digital data transport stream 200 by local broadcast facility 1 10. 
The exemplary time frame T of outgoing digital data transport stream 250 now comprises 

25 non-replaceable packets 201-203 and 207-209, inserted packets (ff ) 25 1 -254, and null 

packet 211, Inserted packets 251, 252, 253, and 254 have replaced replaceable packets 204, 
205 and 206 and null packet 210, respectively. In an exemplary embodiment of the present 
invention, incoming digital data transport stream 200 and outgoing digital data transport 
stream 250 may be MPEG data transport streams and the non-replaceable packets and 

30 replaceable packets are basic MPEG data blocks. 

The present invention introduces a simple way of estimating the available data 
bandwidth using statistics and electronic program guide (EPG) informatioa To predict the 
available data bandwidth (i.e., null packets plus replaceable data packets), the present 
invention predicts the frequency of the data packets of an elementary stream in a virtual 
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channel. The data frequency (say, over a period of one second) of an elementary stream is, 
from a statistic point of view, a random number. However, due to the correlation of the 
scenes of a program and the encoding algorithms, the data frequency of the encoded program 
over one short period may be correlated to that over the next short period. This dependency 
makes it possible to predict the data frequency in the near future based on one or both of the 
current data frequency and the past data frequency. 

The statistics of one program may be different from that of another. EPG 
information of a transport stream describes the program line-up of the virtual channels of a 
transport stream. It provides the schedule, program type, and a brief description of an 
upcoming program. The program type and brief description of a program (e.g., a baseball 
game, a news program, an action movie) may be used by the present invention to estimate 
how much data throughput is required for the program. For example, an action movie 
noraially needs more data bandwidth than a newscast program. As a result, by analyzing the 
EPG inforaiation of a transport stream, the present invention may estimate or detect the 
following data stream events or parameters: 

1) When the data frequency of a virtual channel may undergo a sharp change. 
Usually, sharp changes occur at the start and finish of a program and at the start and finish of 
a commercial; and 

2) Typical (i.e., average) available data frequency of a program. 
Combining a statistic method based on correlation of data frequencies and analysis of EPG 
information, the present invention comprises a data frequency estimation apparatus and 
method based on time series and filtering methods. 

Fig. 3 illustrates in greater detail selected portions of local broadcast 
facility 110 according to one embodiment of the present invention. Local broadcast 
facility 110 comprises input buffer 310, video processor 320, output buffer 330, memory 340, 
and replacement data packet source 350. Memory 340 stores packet replacement 
program 341, which is executed by video processor 320. As will be explained below in 
greater detail, packet replacement program 341 contains, among other things, the code for the 
data frequency estimation algorithms used to insert new data packets into the available 
bandwidth in incoming digital video transport streams. According to an advantageous 
embodiment of the present invention, memory 340 may comprise a removable media drive, 
such as a CD-ROM drive and packet replacement program 341 may be a removable media 
disk that contains the code for the data firequency estimation algorithms. 
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Input buffer 310 receives an incoming digital video transport streams, such as 
exemplary incoming digital video transport stream 200, and stores the incoming digital video 
transport stream in input video stream block 311. Operating under the control of packet 
replacement program 341, video processor 320 retrieves each data packet in incoming video 
5 stream block 311 and determines whether each data packet is a non-replaceable packet 
(NRP), a replaceable packet (RP), nor a null packet (NP). According to an exemplary 
embodiment of the present invention, video processor 320 may identify the packet type of 
each data packet using MPEG header information associated with each data packet. 

Aflar video processor 320 identifies which data packets in incoming video 

10 stream block 3 11 are replaceable packets or null packets, video processor 320 replaces at 
least some of the original replaceable packets or null packets with inserted packets (IP) 
retrieved from replacement data packet source 350, thereby forming the outgoing digital 
video transport stream. Replacement data packet source 350 may comprise any know storage 
device, including a CD-ROM drive, and DVD drive, a VCR tape, or a network feed over 

15 which another incoming digital data transport stream is being received Video processor 320 
then stores the new outgoing digital video transport stream in output video stream block 33 1 
in output buffer 330. 

Fig. 4 depicts flow diagram 400, which illustrates the data frequency 
estimation algorithm performed by video processor 320 according to one embodiment of the 

20 present invention. Video processor 320 uses the frequency estimation algorithm to estimate 
(or predict) the data frequency of an elementary stream over the next period of S seconds 
(e.g., 100 msec, or 0.1 sec). Initially, video processor 320 determines the program start time, 
to, and finish time, tl, using, for example, the EPG information of the program. Video 
processor 320 also determines (or is given) the values a(k) for k=0, 1,. . ., m, where k is the 

25 index of a past period of N seconds, a(k) is a parameter (or weighting factor) associated with 
the k**' period, and m is the number of past and current periods used for prediction. According 
to an exemplary embodiment of the present invention, k, m, and a(k) may be chosen based on 
the program type (e.g., sports programs, newscast, action movie) as determined from the EPG 
information. 

30 Under control of packet replacement program 341 , video processor 320 ^ 

executes the following Prediction Model algorithm to estimate the data frequency in the 
(k+1) period: 

f (k+1) = a(m)f(k) + a(m-l)f(k-l) +. . .+ a(0)f(k-m), 
for k = N,N+l,N+2,... 
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The tenn f(k) is the data frequency of the replaceable and null packets in a program during 
the time period. For example, if during a first selected time period 100 total data packets 
are received and among themi, there are 1 0 null packets and 15 replaceable packets, then f(k) 
= 25/100 = 0.25 for the first selected period. 

The k* time period is a period of n milliseconds (e.g., 100 msec.) during 
which the data frequency of the null and replaceable packets are measured or predicted. Here 
the number n, a constant, is selected by the data insertion system. Initially, fi[k), f(k-l), f(k-2), 
. . ., f(k-m) may be set to zero. The Prediction Model is based on the assumption that future 
data frequency is correlated with past and current data frequency. Note that f (k+l) is the 
estimate of f(k+l) using a prediction model and previous data frequencies f(k), f(k-l), f(k-2), 
so and so forth. The temis a(j) for j = 0, 1, 2, ... are the parameters of the exemplary 
Prediction Model. Note tiiat f(k), for k = N, N-fl, . . on the right hand side of the equation are 
real measurements, not predictions. 

The following algorithm is a reference algorithm for iq^dating the Prediction 
Model and estimating f=(k+l). Other algorithms for updating the Prediction Model and 
calculating jf=(k+ 1 ) also may be usefrd. 

Initialize f(k) and a(k) (Process Step 405): 

- Video processor 320 measures the first N f(k) frequencies based on the real 
data, startmg at time tO, the start of program. Video processor 320 tallies tiie number of 
replaceable and null packets against the total packets in the first N time periods. N is 
sufficiently large, usually larger than m, tiie number of parameters in the Prediction Model. 
Video processor 320 also initialize aQ) for j=0, 1, 2, . . m. These are typical parameters for 
a given type of program. The EPG information may be used to determine program type. 

Prediction (Process Step 410): 

- At the end of period K, video processor 320 has measured f(k), k = K, K-1, 
K-2, . . ,, where K is greater than or equal to N. Video processor 320 then uses the Prediction 
Model to predict f (K+1), the data fi:equency for the next time period, based on the measured 
values of f(k) for k= K, K-1, K-2, . . . according to: 

f (K+1) = a(m)f(K) + a(m-l)f(K.l) + . . , + a(0)f(K-m). 
Update a(k) (Process Step 415): 

- As tune proceeds, video processor 320 arrives at the end of time period K+1 . 
Now, video processor 320 measures the real value of f(K+l). The difference between the real 
f(K+l) and the predicted f (K+1) is a good measure of how accurate the Prediction Model is. 
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Video processor 320 can use the difference to adjust the Prediction Model to make it more 
accurate in prediction. The following model is used to adjust the Prediction Model: 

[f(k+l)-f (k+1)] = a(m)f(k) + a(m-l)f(k-l) +. . .+ a(0)f(k-m), 
for k=K, K-1, K-2, . . where aQ) = a_update(j) ~ a(j). 
5 Video processor 320 solves the above equation for a(j), j=0,l,2,. . m. Video processor 320 
then updates the Prediction Model with a(j) = a_update(j) = a(j) + a(j). 
Loop (Process Step 420): 

• Video processor 320 then predicts the data fiequency for the next time 
periods, K-l-2, K+3, ... by repeating process steps 410 and 415 until the end of program is 
1 0 reached at time tl . 

A filtering algorithm may be used to detect the spikes that usually result from 
sudden scene changes. These sudden scene changes can be part of the program or a 
commercial break. Various statistics techniques can be used to smooth out the effect of 
spikes so that the estimations are accurate. With regard to the initial values of aQ), 1=0, . . 
15 m, if these values are known from previous estimations for other programs of the same type, 
the present invention may use them. Otherwise, they may be assumed to be zero initially. 

Although the present invention has been described in detail, those skilled in 
the art should understand that they can make various changes, substitutions and alterations 
herein without departing from the spirit and scope of the invention in its broadest form. 
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1 • An apparatus for inserting new data packets into an incoming digital video 

transport stream containing a plxirality of original data packets, said apparatus comprising: 

- an input buffer (3 1 0) capable of storing said original data packets of said 
incoming digital video transport stream; and 

- a video processor (320) capable of retrieving said stored original data packets 
from said input buffer (310) and detennimng from said original data packets N data 
frequencies associated with N most recently received ones of said plurality of original data 
packets, wherein said video processor (320) is arranged for estimating from said N data 
frequencies an estimated data fi^uency of a plurality of next inconung original data packets 
and for using said estinoiated data frequency to determine an ins^on rate at which said new 
data packets may be inserted into said plurality of next incoming original data packets. 

2. The apparatus as set forth in claim 1 wherein said video processor (320) is 

further capable of identifying in said stored original data packets replaceable data packets not 
associated with at least one elementary data stream comprising a program carried in said 
incoming digital video transport stream. 

3- The apparatus as set forth in claim 2 wherein said video processor (320) is 

arranged for insertuig said new data packets into said plurality of next incoming original data 
packets by replacing at least one replaceable data packet in said plurality of next incoming 
original data packets. 

4. The apparatus as set forfli in claim 1 wherein said video processor (320) is 
further capable of identifying in said original data packets null data packets. 

5. The apparatus as set forth in claim 4 wherein said video processor (320) is 
arranged for inserting said new data packets into said plurality of next incoming original data 
packets by replacing at least one null data packet in said plurality of next incoming original 
data packets. 
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6. The apparatus as set forth in claim 1 wherein said video processor (320) is 
arranged for estimating said insertion rate as a function of a summation of the M most 
recently received ori^nal data packets. 

7. The apparatus as set forth in claim 6 wherein each of said M most recently 
received original data packets in said summation is scalable by a weighting factor, a(k). 

8. A method for inserting new data packets into an incoming digital video 
transport stream containing a plurality of original data packets, the method comprising the 
steps of: 

- storing the original data packets of the incoming digital video stream; 

- retrieving the stored original data packets from the input buffer (3 10); 

- determining from the original data packets N data frequencies associated 
with N most recently received ones of the plurality of original data packets; 

- estimating from the N data frequencies an estimated data frequency of a 
plurality of next incoming original data packets; and 

- using the estimated data frequency to determine an insertion rate at which the 
new data packets may be inserted into the plurality of next incoming original data packets. 

9. The method as set forth in claim 8 fiirther comprising the step of identifying in 
the stored original data packets replaceable data packets not associated with at least one 
elementary data stream comprising a program carried in the incoming digital video transport 
stream. 

10. The method as set forth in claim 9 further comprising the step of inserting the 
new data packets into the plurality of next incommg original data packets by replacing at 
least one replaceable data packet in the plurality of next incoming original data packets. 

1 1 - The method as set forth in claim 8 further comprising the step of identifying in 

tixe original data packets null data packets. 
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12- The method as set forth in claim 1 1 furflier comprising the step of inserting the 

new data packets into the plurality of next incoming original data packets by replacing at 
least one null data packet in the plurality of next incoming original Hn*n packets. 

13. The method as set forth in claim 8 wherem the step of using the estimated data 
frequency to determine the insertion rate comprises the sub-step of estimating the mserticn 
rate as a function of a summation of the M most recaitly received original data packets. 

14. The mediod as set forth in claim 13 further comprising the sub-step of scaling 
each of the M most recently received original data packets in the simimation by a weighting 
fector, a(k). 

15. A television broadcasting system (100) comprising: 

- a plurality of network video sources (121,122,123), eadi of said plurality of 
network video sources (121,122,123) capable of transmitting at least one digital video 
transport stream to another fecility (1 10) in said television broadcast system (100); and 

- a plurality of broadcast faciUties (1 10), each of said plurality of broadcast 
facilities comprismg an apparatus for inserting new data packets uito a received one of said at 
least one digital video transport stream containing a plurality of original data packets, said 
apparatus comprising: 

* an input buffer (3 1 0) capable of storing said original data packets of said 
received digital video transport stream; and 

* a video processor (320) capable of retrieving said stored original data 
packets from said input buffer (3 1 0) and determining from said original data packets N data 
frequencies associated with N most recently received ones of said plurality of original data 
packets, wherein said video processor (320) is arranged for estimating from said N data 
frequencies an estimated data frequency of a plurality of next incoming origmal data packets 
and for using said estimated data frequency to determine an insCTtion rate at which said new 
data packets may be inserted into said plurality of next incoming original data packets. 

1 6. The television broadcasting system (1 00) as set forth in claim 1 5 wherein said 
video processor (320) is further capable of identifying in said stored original data packets 
replaceable data packets not associated vsdth at least one elementary data stream comprising a 
program carried in said received digital video transport stream. 
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17. The television broadcasting system (100) as set forth in claim 16 wherein said 
video processor (320) is arranged for inserting said new data packets into said plurality of 
next incoming original data packets by replacing at least one replaceable data packet in said 

5 plurality of next incoming original data packets. 

18. The television broadcasting system (100) as set forth in claim 15 wherein said 
video processor (320) is further capable of identifying in said original data packets null data 
packets. 

10 

19. The television broadcasting system (100) as set forth in claim 18 wherein said 
video processor (320) is arranged for inserting said new data packets into said plurality of 
next incoming original data packets by replacing at least one null data packet in said pluraUty 
of next incoming original data packets. 

15 

20. The television broadcasting system (100) as set forth in claim 15 wherein said 
video processor (320) is arranged for estimating said insertion rate as a function of a 
summation of the M most recently received original data packets. 

20 21. The television broadcasting system (1 00) as set forth in claim 20 wherein each 

of said M most recently received original data packets in said summation is scalable by a 
weighting factor, a(k). 



BNSDCX:iD: <WO_Q20eS032A2LL> 



wo 02/085032 



PCT/IB02/01171 



1/3 




BNSDOCID: <WO_020B5032A^L> 



wo 02/085032 



PCT/IB02/01171 



2/3 



NP 


NRP 


NRP 


NRP 


RP 


RP 


RP 


NRP 


NRP 


NP 


NP 


NRP 




201 


\ 

202 


1 

203 


\ 

204 


\ 

205 


\ 

206 


\ 

207 


208 


[ 

209 


<, 

210 


211 



FIG. 2A 



200 



NP 


NRP 


NRP 


NRP 


IP 


IP 


IP 


NRP 


NRP 


NRP 


IP 


NP 


NRP 




201 


\ 

202 


1 

203 


\ 

251 


\ 

252 


\ 

253 


I 

207 


208 


209 


\ 

254 


\ 

211 





FIG. 2B 



^250 



BNSDOCID: <WO__020eS032A2_L> 



wo 02/085032 



PCT/IB02/01I71 



3/3 



110- 



310 

1 



MEMORY 

PACKET 
REPLACEMENT 
PROGRAM 



INPUT 
BUFFER 



INPUT 
VIDEO 
STREAM 



340 



•341 



311 



VIDEO 
PROCESSOR 

T 

320 



OUTPUT 
BUFFER 



OUPUT 
VIDEO 
STREAM 



REPLACEMENT 
DATA PACKET 
SOURCE 



331 



T 

330 



350 



110- 



400 



FIG. 3 



START 



INITIALIZER) AND a(k) 



405 



PREDICT f(k+1) 




r 


UPDATEaCk) — 




r 



ijOy END OF 
\ PROGRAM? 

r 

STOP 



410 
'415 

-420 



FIG. 4 



BNSDCX:iD: <WO_020e5032A2J_> 



(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 




(19) World Intellectual Property Organization 

InicmaiionaJ Bureau 

(43) International Publication Date (10) International Publication Number 

24 October 2002 (24.10.2002) pCT WO 02/085032 A3 

(51) International Patent Classification^: H04N 7/24 (74) Agent: GROENENDAAL, Antonius, W., M.; Iniema- 

tionaaJ Oclrooibureau B.V., Prof. Holstlaan 6, NL-5656 

(21) International Application Number: PCT/IB02/01 171 Eindhoven (NL). 

(22) International Filing Date: 2 April 2002 (02.04.2002) ^^^^ designated States (national): CN, JP. KR. 

. (84) Designated States (regional): European patent (AT, BE. 

(25) Filing Language: English CH, CY, DE. DK, ES, H, FR, GB, GR, IE, IT, LU. MC, 

NL, PT, SE, TR). 

(26) Publication Language: English 

Published: 

(30) Priority Data: — ^'^^ international search report 

09/829,786 10 April 2001 (10.04.2001) US ~ ^^-^^''^ expiration of the time limit for amending the 

claims and to be republished in the event of receipt of 
amendments 

(71) Applicant: KONINKLIJKE PHILIPS ELECTRON- 
Hndhovll"^ Groenewoudseweg 1, NL-5621 BA (gg. Date of publication of the International search report: 

" 3 January 2003 

(72) Inventors: LU,Jin;Prof. Holstlaan 6, NL-5656 AA Eind- For two-letter codes and other abbreviations, refertothe "Guid- 
^ *i"vcn (NL). DEVARA, Kavitha, V.; Prof. HolsUaan 6, ance Notes on Codes and Abbreviations'* appearing at the begin- 

NL-5656 AA Eindhoven (NL). ning of each regular issue of the PCT Gazette. 



(54) Title: 
STREAM 



SYSTEM AND METHOD FOR INSERTING VIDEO AND AUDIO PACKETS INTO A VIDEO TRANSPORT 



110 



< 

ID 
QO 

O 



310 



MEMORY 



PACKET 
BEPWCEMEWr 
PROGRAM 



INPUT 
BUFFER 



INPUT 
VIDEO 
SIBEAM 



•340 



-341 



VIDEO 
PROCESSOR 



311 



7 

320 



OUTPUT 
BUFFO? 



OUTPUT 
VIDEO 
STREAM 



REPLACEMBJT 
OATAPACKB 
SOURCE 



331 



330 



^350 



(57) Abstract: There is disclosed an apparatus for inserting new data packets into an incoming digital video transport stream con- 
taining a plurality of original data packets. The apparatus comprises: 1) an input buffer for storing the original data packets of the 
incoming digital video stream; and 2) a video processor that retrieves the stored original data packets from the input buffer and de- 
termines from the original data packets N data frequencies associated with N most recently received ones of the plurality of original 
data packets. The video processor estimates from the N data frequencies an estimated data frequency of a plurality of next incoming 
original data packets and uses the estimated data frequency to determine an insertion rate at which the new data packets may be 
inserted into the plurality of next incoming original data packets. 



BNSDOCID: <WQ_020e5032A3_L> 



INTERNATIONAL SEARCH REPORT 


If nal ApplleaUon No 

PCT/IB 02/01171 


I PcT'^'^Holf/zif '"''^ MATTER 

According to Jntemational Patent Classfricallon (IPC) orlo twth national dassiflcatlon and IPC 




B. RELDS SEARCHED 


Minimum documentation searched (classification system foflowed by classification symbols) " " ' • 

IPC 7 H04N 


Documentation searched other than minimum documentaUon to the extent that such documents are included in the fields searched 


Eiectronfc data base oonsuHed during the rntematbnal search (name of data base and, where practical, search terms used) 

WPI Data, PAJ, EPO-Internal , INSPEC 


C. DDCUM 


ENTS CONSIDERED TO BE RELEVANT 


Category •* 


Citation of document, wtth indication, where apprepiiate, of the relevant passages 


Relevant to daim No. 


X 

A 
A 


EP 0 926 894 A (CANAL PLUS SA) 
30 June 1999 (1999-06-30) 

•0016!-'0019!,'0051! 
figure 2 

WO 98 53614 A (THOMSON CONSUMER 
ELECTRONICS) 26 November 1998 (1998-11-26) 
column 10, line 38 -column 13, line 35 

WO 00 16560 A (SCIENTIFIC ATLANTA) 

23 March 2000 (2000-03-23) 

abstract; figure 5 

page 2, line 27 -page 3, line 27 

page 8, line 15 - line 25 

page 12, line 21 -page 15, line 35 

page 19, line 20 - line 31 

-/-- 


1-5, 

8-12, 

15-19 

1-21 

1-21 


^ Furtherdocumenlsarelistedlnthe cominuationofboxC. ^ Patent family membera are listed 


In annex. 


T later document published after the intemallonal filing date 
■A* document defining the general state of the art which is not or priorfty date and not In conflict with the application but 

considered to be of paiticuiar relevance cited to understand the principle or theoiy underlying the 
■E' earner document but published on or after the fntemaUonal invention 

filing date X* document of particular relevance; the claimed invention 
•L" document which may throw doubts on orioritv claimfB\ or ^ considered novel or cannot be considered to 

Which is cited to eiablXthe publican ""^^^^^ ^" step when the document Is taken alone 

dtatton or other special reason (as specified) "Y" document of particular relevance; the claimed invention 

•P- do»mempuwishedprtor.o.telrtemauonal BBngdarebu. . mente^uch combination being obvious to a pensonatdBed 
laterthantheprioritydateciaimed document member ot the same patent lamily 


uaie or the actual completion of the international search 

29 October 2002 


Date of mailirtg of the Intemalional search report 

06/11/2002 


European Patent OfRce, P.B. 5816 Patentlaan 2 
NL-2280HVRrjswi]k 
TeL (+31-70) 340-2040. Tx. 31 651 epo nl. 
Fax: (+31-70) 340-3016 


Authorized officer 

La, V 



page 1 of 2 

BNSIDOCID: <WO_020e5032A3J_> 



INTERNATIONAL SEARCH REPORT 



In nai Application No 

PCT/IB 02/01171 



C.(Contlniiation) DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 


CAation of document, with incBcatlon.where apprapriate. of the relevant passages 


Relevant to claim No. 


A 


US 6 078 958 A (ECHEITA RICHARD J ET AL) 
20 June 2000 (2000-06-20) 
dcrubiuii ouiiiiiiar jr uT Lrie invenxion 


1-21 


A 


us 5 754 783 A (GOLDMAN MATTHEW S ET AL) 

19 May 1998 (1998-05-19) 

abstract 


1-21 


A 


US 5 966 120 A (SHEN PAUL ET AL) 
12 October 1999 (1999-10-12) 
abstract 


1-21 



P.A 



WO 01 43448 A (MITCHELL ARTHUR JOHN 
WILLIAM ;SNELL & WILCOX LTD (-.66)) 
14 June 2001 (2001-06-14) 
abstract 



1-21 



Foim PCT/ISA/210 (contlnuaUon of second sheet) (July 1892) 

page 2 of 2 

BNSDCX:iD: <WO_020e5032A3J.> 



INTERNATIONAL SEARCH REPORT 



Ir nal Appiicatlon No 

PCT/IB 02/01171 



Patent document 
cited in search report 



Publication 



Patent family 
member(8) 



Publication 



EP 0926894 


A 


30-06-1999 


FP 




ju-oo-iyyy 








ALJ 


1777000 A 


12-07-1999 








RR 
Dl\ 


Q01 O^l Q A 


17-10-2000 








PA 


9"^! 1 /I QD A 1 


01-07-1999 










1 OQCl 1/1 T 
i^ODiI4 1 


21-02-2001 








Li 


1U4U00O Al 


04-10-2000 








MP 


9nnnn*5Qi ai 
^UUUUooX Al 


31-12-2000 








HU 


0101152 A2 


30-07-2001 








WO 


9933271 Al 


01-07-1999 








-IP 


cUUio^/obU 1 


25-12-2001 








NO 


C\j\i\}6c.H 1 A 


23-08-2000 








PI 

r u 


o«tiooy Ai 


09-04-2001 








TP 


9nnnni Q9i to 


21-12-2000 











OP 1 1 Q 1 O A 


17-08-1999 


WO 9853614 


A 


26-11-1998 


US 


6233253 Bl 


15-05-2001 








All 
nU 


717/IQOD A 

/o/'loyo A 


11-12-1998 








RP 
Dl\ 


QpnOI C7 A 

youyio/ A 


01-08-2000 








PP 

ur 


luiouyo Ai 


28-06-2000 








.IP 


CUUiO^OoDo I 


in to no o H 

18-12-2001 











yoDoDl4 Al 


26-11-1998 


WO 0016560 


A 


23-03-2000 


us 


6219358 Bl 


17-04-2001 








BR 


9913556 A 


05-06-2001 








DE 


1112659 11 


20-12-2001 








EP 


1112659 Al 


04-07-2001 








JP 


2002525926 T 


13-08-2002 










UUiOooU Al 


23-03-2000 


US 6078958 


A 


?o— nfi— ?nnn 

\J\J L.\i\J\j 


IMUIMt. 






US 5754783 


A 


19-05-1998 


NONE 






US 5966120 


A 


IP— in-1QQQ 


All 
MU 


/ / fc^ySo A 


11-06-1997 








EP 


0862836 Al 


09-09-1998 








JP 


2000500632 T 


18-01-2000 








WO 


9719560 Al 


29-05-1997 


WO 0143448 


A 


14-06-2001 


GB 


2357210 A 


13-06-2001 








AU 


2189301 A 


18-06-2001 








WO 


0143448 Al 


14-06-2001 



Pofm PCT/ISA/210 (patent family annex) (July 1992) 



BNSDOCID: <WO_020B5032A3J_> 



